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ABSTRACT 



A method for combining two templates. A first template 
having a first minutia set and a second template having a 
second minutia set are provided. The first template is com- 
pared with the second template to obtain a matching minutia 
set. Registration parameters are calculated &om the match- 
ing minutia set. The registration parameters can be refer- 
enced to either the first minutia set or the second minutia set. 
All minutiae in the first or the second minutia set are 
translated to be on the same coordinate system as the other 
minutia set. The minutia sets are then combined to construct 
a combined minutia set. In one embodiment, an overlap 
region is drawn for the first template and the second 
template, the overlap region containing at least minutiae 
from the matching minutia set The combined minutia set is 
constructed from the matching minutiae in the first or the 
second template, minutiae in the first minutia set that are not 
in the matching minutia set, and minutiae in the second 
minutia set that are not in the matching minutia set In 
another embodiment, minutiae in the overlap region but not 
part of the matching minutia set are discarded. 
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METHOD FOR COMBINING FINGERPRINT these manufacturers will continue to cost-reduce their prod- 

TEMPLATES REPRESENTING VARIOUS ucts to stay competitive. One way to reduce cost is to 

SENSED AREAS OF A FINGERPRINT TO decrease the size of the sensor. However, as the sensors gel 

DERIVE ONE FINGERPRINT TEMPLATE smaller, the matching accuracy is correspondingly reduced 

REPRESENTING THE FINGERPRINT 5 because less data is available for comparison- Furthermore, 

the size of the fingerprint sensor is often limited by the size 
of the finger in order to obtain a fiill fingerprint. 

CROSS REFERENCE TO APPENDIX Placing the user's finger on the sensor in different posi- 

Appeodfat A, which is a part of the present disclosure, is ,„ «i°°i'«»<' ""en pasting the images of the sensed portions of 

a listing of software code for embodiments of components of ^'^ together is one solution in reducing the size of a 

this invention, which are described more completely below. ^ftp^i sensor. TTie images taken &om the various areas 

...... .... . , J . of the finger are typically ahgned with a registration soft- 

A portion of the disclosure of this patent document cssentiaUy "glued" together. 

contains matenal which is subject to copynght protection. . ^r^. . 

The copyright owner has no objection to the facsimile ^5 FIG. lA shows an image 10 havmg a parUal fi^^^ 

reproduction by anyone of the patent document or the patent I IB shows an image 12 havmg a partial 

disclosure, as it appears in the Patent and Trademark Office fiogen>nnt from the same finger but at a different posiUon. 

patent files or records, but otherwise reserves all copyright ^ ,^^9^' ^.r^.^^' ovcthps 

rights whatsoever. image 12. For example, unage 10 shows the top portion of 

a fingerprint while image 12 shows the bottom portion of the 

FIELD OF THE INVENTION same fingerprint and both images 10 and 12 show the middle 

portion of the fingerprint. FIG. IC shows an image 14 

This invention relates to fingerprint verification. More having a combined fingerprint derived by gluing images 10 

particularly, this invention relates to methods for combining and 12 together using an image correlation algorithm, for 

fingerprint templates obtained fiom various portions of a example, as described by Dana H. Ballard and Christopher 

finger into one fingerprint template representing the com- 25 Brown in a book entitled "Computer Vision" (1982) on 

bined fingerprint. pages 65-71, hereby incorporated by reference. 

BACKGROUND OF THE INVENTION image correlation, a template is created from a par- 
ticular feature which is in effect a subimage. A similarity 

Biometric identification is used to verify the identity of a ^ measure is computed which reflects how well the image data 

person by digitally measuring selected features of some of another image match the template for each possible 

physical characteristic and comparing those measurements template location. The point of maximal match is then 

with those filed for the person in a reference database, or selected as the location of the feature. The template- 

sometimes on a smart card carried by the person. Physical matching calculations may be visualized by imagining the 

characteristics that are being used include fingerprints, template being shifted across the image to different oBfeets to 

voiceprints, the geometry of the hand, the pattern of blood locate \^iicre in the image the feature occurs. The two images 

vessels on the wrist and on the retina of the eye, the can then be aligned and combined. ^ 

topography of the iris of the eye, facial patterns and the However, image aUgnment, e^ecially for pooriy imaged 

dynamics of writing a signature and typii^ on a keyboard. finggj^ resulting fi-om, for example, dry fingers, is a difficult 

The fingerprint is one of the most widely used physical ^ task and is computationally expensive. Furthermore, 

characteristics in biometric identification. Fingerprints are because the finger has a fluid surface, the surface of the 

utilized as the most reliable means to identify individuals finger stretches and varies under different conditions. Hence, 

because of two outstanding characteristics, namely that they the ridge definition is rarely exactly the same twice. This 

remain unchanged all through life and differ from individual inherent difference causes the overlap regions to be different, 

to individual. Fingerprints consist of raised friction ridges of 45 producing an artifact effea when glued together. In other 

skin separated by recessed valleys of ^dn. Fingerprint words, the overlap region appears to be formed by two 

"minutiae" are conventionally defined as ridge endings or difOerent sources because the transition at the overlap 

ridge bifurcations where a ridge splits into two ridges. regions is not smooth. Therefore, the image correlation 

Since the matching of a fingerprint as an image can algorithm must take these conditions into account during the 

require large file capacity to store the measured and refer- 50 match, thereby requiring additional computation. A further 

enced features and complex computation to match measured problem is rotation which must be taken into account 

features with reference features, fingerprint identification is because the various portions of fingerprint may be obtained 

carried out using the positional relationship of features or with the finger in different orientations, 

minutiae that are extracted from the fingerprint image. The Therefore, what is needed is a method for combining 

minutiae representing a fingerprint image are digitized and 55 various templates from various portions of a finger, the 

stored in a digital memory, which may be a read-only method being computationally inexpensive, 
memory, magnetic tape, or the like. A fingerprint digitized in 

this manner may be compared with reference fingerprints SUMMARY OF THE INVENTION 
stored in the memory. For the comparison to work, the A method for combining two templates. A first template 
reference fingerprint and the measured fingerprint must be 50 having a first minutia set and a second template having a 
extracted, characterized, and digitized so that the fingerprint second minutia set are provided. In one embodiment, each 
templates contain the same information and have the same template comprises at least one data chunk which represents 
format. one minutia. Each minutia is characterized by a location, a 
As fingerprint sensing gains momentum in application, minutia angle and a neighborhood. The location further 
manufactiuers are gearing up for high volume production, 5S includes an x-coordinale and a y-coordinate. The neighbor- 
deploying both silicon-based sensors as well as the tradi- hood includes a plurality of neighbors, each having a dis- 
tional optical sensors. As the production volumes increase, tance from the selected minutia and two related angles. In 
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one embodiment, all the parameters are quantized to reduce FIG. 5 shows construction of positional parameters for a 

the bits required to represent the distance and the related neighbor minutia. 

angles of a minutia, hence decreasing the memory require- piG. 6 shows two neighborhoods with errors between 

ment. them. 

The first template is compared with the second template 5 p,Q ^^^^ ^ ^^^^ ^y^^^ ^ ^ fingerprint template 

to obtain a matching mmutia set. The templates are com- comprising location, minutia angle and neighborhood 

pared on a data chunk by data chunk basis and by comparing parameters 

each characterization parameters of the data chimks. Com- ™^ ^mi. .i^n 

J . t. 1 u J ^ L 1 L • 11 rlG. 7B shows a data chunk m another fingerprint tem- 

panng on a data chunk by data chunk basis allows a , , • • i • *• i j • ^ 

^ ,1. 1 1 . . .t. in plate compnsmg location, mmutia angle and neighborhood 

computer with low computational power to execute the lO ^ * ^ ^ 

narameters 

template matching algorithm. If all characterization param- 

eters match, the data chunks match. The matching minutia '^^ ^^^^ * neighborhood for a fingerprint template 

pair is stored as a part of a matching minutia set in a memory ^^^S various positional parameters. 

accessible by a computer. FIG- shows a neighborhood for another fingerprint 

Registration parameters are calculated from the matching template having various positional parameters, 

minutia set. Each registration parameter is calculated by FIG. 8 shows a flowchart of a method of fingerprint 

summing the difference of each minutia pair in the matching template comparison. 

minutia set and dividing the sum by the number of minutia FIG. 9 shows a flowchart of a method of combining two 

pairs in the matching minutia set. In one embodiment, the fingerprint templates. 

registration parameters are in reference to the first minutia ^ p,G iqA shows a first minutia set containing minutiae 

set. In another embodiment, the registration parameters are obtained from a portion of a finger 

in reference to the second minutia set. rnr^ u j • • * • • - 

RG. lOB shows a second mmutia set contaimng mmuUae 

AU minutiae in the minutia set that is not the reference obtained from another portion of the same finger. 

minutia set are translated to be on the same coordinate cir- mo r.u^„r^ « i ^^^^^a f « 

• . r™. 25 FIG. lOC shows a translated second mmutia set. 

system as the reference mmutia set. The translation IS done r-^^ ^^t^ i ,. , . . 

by adding the registration parameters to the characterization , ™- ^ combmcd mmutia set constructed from 

parameters of the minutia set that is not the reference ^"^^ '"^^^^ translated second mmutia set. 

minutia set. The minutia set and the translated minutia set ^ shows a first minutia set containing minutiae 

are then combined to construct a combined minutia set. In obtained from a portion of a finger, having an overlap region 

one embodiment, an overlap region is drawn for the first ^° another minutia set. 

minutia set and the second minutia set. In one embodiment, FIG. IIB shows a second minutia set containing minutiae 

the overlap region is the smallest possible rectangle enclos- obtained fi'om another portion of the same finger, having an 

ing all matching minutiae. The combined minutia set is then overlap region with the first minutia set. 

constructed from the matching minutiae in the first or the FIG. UC shows a translated second minutia set. 

second template, minutiae in the first minutia set that are not piG. IID shows a combined minutia set constructed from 

in the matching minutia set, and minutiae in the second the first minutia set and the translated second minutia set 

minutia set that are not in the matching minutia set. In xhe use of the same reference symbols in different draw- 

another embodiment, mmutiae m the overlap region but not indicates similar or identical items, 
part of the matching minutia set are discarded. 

By combining two templates firom two images taken from DETAILED DESCRIPTION 
a finger at different positions, a combined template repre- 2 ^ows a fingerprint template 20 (T,,^^ con- 
senting the larger, combmed maage is obtamed. Tins com- ^^^^jed from two images (hereinafter, partial fingerprint 
bmed teinplate can then be used m fingcrpnnt matching. i^^^g^^ 22 and 24) obtained from different areas of a 
Hence, the size of the sensor can be decreased while fiogcn)rint in accordance with the present invention. Minu- 
retaimng matching accuracy at a reduced cost. tiae are extracted from partial fingerprint image 22 in 
BRIEF DESCRIPTION OF THE DRAWINGS minutiae extraction step 26. A fingerprint template Tj is 

created in step 28 from the extracted minutiae using methods 

The present invention may be better understood, and its well known in the art. Similarly, minutiae are extracted from 

numerous objects, features, and advantages made apparent 50 partial fingerprint image 24 in minutiae extraction step 30 

to those skilled in the art by referencing the accompanying and a fingerprint template T^ is then created from the 

drawings. extracted minutiae in step 32. Fingerprint template T^ and 

FIG. LA is an image containing a partial fingerprint. fingerprint template T^ are compared in step 34 to locate 

FIG. IB is an image containing a partial fingerprint. matching minutiae using a fingerprint matching algorithm as 

FIG. IC is an image containing a fingerprint constructed 55 desaibcd in, for example, co-pending U.S. patent applica- 

from the partial fingerprints shown in FIG. lAand FIG. IB. ^er. No. 09/354,929, hereby incorporated by reference 

FIG. 2 shows a fingerprint template constructed from two ^ Matching minutiae pairs are then printed or 

partial fingerprints in accordance with the present invention. ^ ^^^"l^^ m step 36 so that a computer can access 

™^ 'ILL • • * J data later. If the number of matching mmutiae pairs is 

rIO. 3 snows now a mmutia is represented. rc*** . j -j 

. , . , . 60 sufficient to meet a predetermmed number, there is a sufiB- 

FIG. 4A shows a circular neighborhood boundary. ^ient overlap region between fingerprint template T^ and 

FIG. 4B shows a square neighborhood boundary. fingerprint template T^ and the fingerprint templates are 

FIG. 4C shows a method of neighbor selection combined in step 38 to derive a combined fingerprint 

FIG. 4D shows an angle to be represented in complex template T^p^-^^ which represents a combined fingerprint 

domain. 65 image. Each step is further described below. 

FIG. 4E shows an embodiment of a method of neighbor A finger is placed on a fingerprint sensor in arbitrary 

selection. positions so that the measured fingerprint portions overlap 
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by at least approximately one-third In general, the size of eters such as a distance between a minutia and one of its 

overlap is predetermined such that the overlap contains neighbor minutiae and two related angles. Data chunk 

stiflSdcnt number of minutiae for a match. The number of generation is described in detail with respect to FIG. 3 which 

matching minutiae required for a match is in turn predeter- shows how each minutia is characterized and FIGS. 4A 

mined based on the accuracy required by a particular appli- 5 through 4E and FIG. 5 which show how a neighborhood is 

cation. For example, accessing a typical office building dioes constmcted 

not require the same security level as accessing a vault in a *^ mr- 1 j - „ «««^t„.«*^^ 

, , ^ ^ a- . nj- 4 I. r T Reiemng to 1*10. 3, au x-axis and a y-axis are oonstructed 

bank. Hence, to access an office building, a match of 7 * • . m a\ • . i i. j r 

minutiae may be required. However, to accL the vault of a f P"""' ^' »^ upper left hand comer of a 

bank, 15 matches may be required. ,„ fingerprint unage. The x-a»s and the y.ax|s are drawn 

. . 1 c . . • 1 11. ^" regardless of the rotation or the translation of the fingerprint, 

Animage, e.g., partial nngerpnnt unage 22, IS taken from n u j- j i * c u • *• • c • I 

£ . f - • u 1 J u ^ will be discussed later. Each mmutia m a fingerprint 

a finger m the first position. The nneer IS then placed on the . - . * - i / \ j ■ *• i 

1- u.i . .u 1 r* * J * t_* • imageischaractenzedby location (x,-,yj and a mmutia angle 

sensor shghtly to the left, right, up or down to obtam a n u - • *u u * • 4^ * -a r 

J . ^ ' . , ... . , o.» where j is the number of mmutiae extracted from a 

second image, e.g. partial nngerprmt image 24. Partial . /. , . \ • *i_ i r - ^- 

£ • j-^^ ft. J.J. fingerprmt image. Location (x,,Y;) is the location of mmutia 

fingerprmt images 22 and 24 are then compared to deter- • -.i. * . j iY- i o . .i. i 

_r . ^. . . , i. L ^ J with respect to x- and y-axis. MinuUa angle 6; is the angle 

mined whether the images arc tajceo from the same finger, i ^ .f j i- » i . •j'' 

, — , " - . , between the x-axis and a line tangential to a ndge 301 where 

1.0., have a sufficient overlap area. K the user moved too ^^^^^ . ^ ^^^^^ impo^ce. all data chunks must 

r '^■^";J?^1^'^J? .1 K^^^^^^i*^ characterizktion parameters. 

than one-third, there is likely no match between partial . . . , .... 

fingerprint images 22 and 24. Since the algorithm is attempt- ^ „;^^'"J8hl»rhood NH,. is constructed for each mmutia j. 

ing to match fingerprint images from the same finger, a FIpS. 4A-4E lUustrate vanous ways of «lectmg neighbor 

match failure is likely due to too much movement. mmutiae in construamgneigbtwrhoodNH, for mmutia j. In 
TTierefore, in one embodiment, the user interface may have embodiment, an optional neighborhood bounda^^ is 

a visual or an audible display to indicate too much move- ^^"T '^"""d mmutia j. For example, a circle 300 of a fixed 

ment. Tlie sensor device may assist the user in placing „ radius r. e.g 90 puels^is drawn usmg mmutia j as tte center 

his/her finger by having sensor markings, for example. pomt as shown in HO. 4A, to provide a nei^borhood 

outlining the finger portion with dash lines. boundary. In an alteraaUve embodiment, a box 310. repre- 

In one embodiment, the fingerprint sensor is a capacitive neighborhood boundary is drawn imng minutia 

fingerprint sensor described ii U S. patem appUcation Ser. ^^J^ ^""^^^^T^ ™- f' ''.-y 

No 08/735.100 filed Dec. 15. 1995, and a^gned to the 30 P^"^^ "''ghbo^o^d ^O'^^^^ °f *«>»P« °' size 
same assignee as the present invention, and is hereby ^ rawn. , . , . 

incorporated by reference in its entirety. In another predetennined nuinber of neighbor minutiae are 

embodiment, the fingerprint sensor is a capacitive finger- '-x ^■"b^odjnient^ fifteen 

print sensor described in VS. patent application Ser. No. (excluding minutia j) withm the nei^borhood 

09/354,386 filed JuH4. 1999, assigned to the same assignee 35 «*u*^ as the neighbor minutiae for neigfa- 

as the present invention, and is hereby incorporated by ^"'^'^ ^ than the 

reference in its entirety. Of course, other types of fingerprint pre«Jf jermined number of neighbor mmutiae, all of the 

sensors can be used neighbor mmutiae contamed m the enclosed area are 

Each partial fingerprint image 22 and partial fingerprint «l«ted. It is noted that ne^borhoodNH,.contaim^^ 

. J L . J J c • * ° ^. neighbor mmutiae N,-N.. where i is a prcdctermmcd 

image 24 is processed by standard fingerprmt processmg 40 u * .i. • ts - c ^ . 1 *u 

so^are to extract minutiae points and to create Lgerprinl f 'j^MJl'"* '"""Sh mformation to make the 

tempUtes. SpecificaUy, minutiae are extracted &om pitial j^'ghborhood IW.umque to meet the accuracy requuemen^ 
fingerprint images 22 and 24 to create fingerprint tenlplates "f/"^ "",§?'*K!!lJ°Nia'T °° 

and T3, res^ctively. Minutiae can be exacted from a ^^^^^^ °f ^H, desired. The unique- 

fiigetprint using any known methods. For example, ridge 45 determmes how °ften a good 

skeletonization Unique can be used. This techirique uL flngerpnnt is rejected (i.e., false rejectton rate) and how 
an iterative process to thin a ridge Une by discarding pixels ^ flngerpnnt is accepted (i.e., false acceptance 

that do not affect the continuity of the ridge line until a single ... , ... . . , . 

pixel Une is remaining, the end point of which is the minutia. ^° embodiment the neighbor mmutiae are selected 

Other types of minutia extraction technique are described in, 50 ^"^^ ^ maxunize the spread around the center pomt, i.e., 

for example, U.S. Pat. No. 4,646,352 entitled "Method and "i"""*?* J" Refc™g to HG. 4C. an x-axis is drawn m the 
Device for Matching Fingerprints with Precise Minutia Pairs of the hne Ungential to a ndge Lne at mmuUa j . A 

Selected From Coarse Pairs" issued Feb. 24, 1987 to Asai et '^'^ ■""^'^'^ J f ^.V ^ 

al. and VS. Pat. No. 4,135,147 entitied "Minutiae Pattern f ^le a, between the x-axis and the hne. Similarly, a Ime is 

Matcher" issued Jan. 16, 1979 to Riganati et al. TTie minutia ss ^'^7^ '^""'V" J ^ remammg minutiae 

extraction technique is not described in further detafl in this ^'^^ the enclosed area, eadi formmg an angle with the 

application because it is not part of the invention. ''""f^ ^"'^ ^'^'^^ of 

A fingerprint template is then generated &om the ^.""^ ^ , 

extracted minutiae by first characterizing each extracted , ^° one embodmient. the mean is calcuUted m a complex 
minutia and then creating a neighborhood for each extracted 60 ^ calculation m a degree domam would be 

minutia. In general, tiie fingerprint template is a collection of """^^ complicated due to the cychcal nature of angles. A 

data chunks, each data chunk representing an extracted """P^^* ^ can be descnbed as a sum of its real and 

minutia and conuining a characterization of that minutia and magmaty parts a and b, respectively, i.e., C=a+ib where 1 is 
its neighborhood. In one embodiment, the characterization square root of -1. 

parameters of a minutia include a location and a minutia 65 Referring to FIG. 4D. angles can be expressed in terms of 

angle. The location contains an x-coordinate and a complex numbers by the foUowing equality: 
y-coordinate. The neighborhood contains positional param- Ct=oos(a^i siii(o^ 
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where 



Thus, the real part of angle Oj^ is ajt-cos(ajt) and the 
imaginary part of angle is b^'^m{Oj). To get an average 5 
of all the angles o)^ each angle Oj^ is converted to its complex 
equivalent. The real part a^^ and the imaginary part b^^ are 
then averaged separately. The averaged real part a^ and the 
averaged imaginary part b^^,^ are then converted back to a 
real number representation a^^- for example. 



10 



15 



20 



and a^v^-tan-^(b,,^a, J. 

In one embodiment, each angle is examined to deter- 
mine how close it is to the average angle a„^,^by subtracting 
angle from average angle o^^^ to get a dSerence Oj^^-^ A 25 
predetermined number of minutiae that have the largest 
difference Oj^gZXt selected so that the entire neighborhood 
has maximum standard angular deviation. It is noted that if 
there is a cluster of minutiae such as cluster 301 i^own in 
FIG. 4C, the average would be closer to cluster 301. Thus 30 
the minutiae that are within cluster 301 would be closer to 
the calculated mean. In one embodiment, if the number of 
minutiae within the bouindary is more than the predeter- 
mined number of neighbor minutiae, the minutiae within 
clxister 301 would not be selected. If one or more minutiae 35 
must be selected from cluster 301 to meet the predetermined 
number of neighbor minutiae, the minutiae are selected 
randomly. In other words, the minutiae within cluster 301 
are less likely to be selected than the minutiae outside of 
chister 301. 40 

In one embodiment, if multiple minutiae, such as minutiae 
N5 and Ng, have the same angles, the distances between 
minutia N5 and minutia j and between minutia Ng and 
minutia j are used for a tie breaker, e.g., the shorter the 
distance, the more likely the minutia would be selected. In 45 
another embodiment, if a minutia, i.e., minutia N3, is too 
close to minutia j, e.g., 10 pixels, the minutia is not selected. 
In yet another embodiment, the neighbor minutiae that are 
furthest away (in distance) &om each other are selected. In 
one embodiment, if two or more neighbor minutiae are very 50 
close to each other, e.g., 10 pixels, such as neighbor minutia 
N5 and neighbor minutia N7, either both neighbor minutiae 
and N7 are eliminated or one of neighbor minutiae N5 
and N7 is arbitrarily selected. 

If no neighborhood boundary is drawn, all extracted 55 
minutiae are used for neighbor selection described above. In 
an additional embodiment, a quadrant is arbitrarily drawn 
with minutia j as the center point and a predetermined 
number of neighbor minutiae are then selected &om each 
quadrant, as shown in FIG. 4E. In general, any neighbor 60 
minutiae extraction method may be used to extract the 
predetermined number i of neighbor minutiae for construct- 
ing a neighborhood NHy. 

After the neighbor minutiae are selected, a neighborhood 
NHy is constructed by deriving three positional parameters 65 
for each neighbor minutia. The positional parameters are 
derived in reference to minutia j. These positional param- 



eters include a distance d,- and two angles ()),- and where 
i is the number of neighbor minutiae. 

FIG. 5 shows how the positional parameters are derived. 
An X-axis is drawn in the direction of the line tangential to 
a ridge line at minutia j. A y-axis perpendicular to the x-axis 
is then drawn, intersecting the x-axis at minutia j. Hence, 
minutia j has a position of (0,0) and wiU be designated as the 
"center minutia Nq." Aline 500 is drawn from center minutia 
Nq to a neighbor minutia N.-. Line 500 has a distance d,-. An 
angle <t>f is created between the x-axis and line 500. Another 
Uc» 501 is drawn from neighbor N; in the direction of a line 
tangential to a ridge line for neighbor minutia to intersect 
and extend through the x-axis. The angle between the 
extended line 501 and the x-axis is angle t))^. Hence, neighbor 
minutia N,- may be represented by (d,-, (|);, {[),•). Importantly, 
distance d^- and angles and are independent of any 
rotation or translation of a fingerprint image because these 
are relative positions with respect to center minutia Nq. 
Hence, when a fingerprint image is rotated or translated, all 
the minutiae associated with that center minutia Nq are 
translated and rotated in the same fashion and amount and 
their relative positions with respect to the center minutia Nq 
remain the same. 

In one embodiment, all the parameters are quantized, for 
example, distance d^ to five bits and angles (|>^ and to six 
bits each. In one embodiment, the location information, ie., 
(Xy,y^) and the minutia angle Oy, are quantized to a selected 
nximber of bits. For example, each of the position measure- 
ments Xy and yy is quantized to four bits and the minutia angle 
Oy is quantized to six bits. Quantization allows the param- 
eters to be represented by fewer bits, thereby decreasing the 
memory requirement. 

FIG. 6 illustrates two neighborhoods with slight errors, 
both rotational and translational. Neighborhood 510 is con- 
structed with a center minutia Nq and two neighbor minutiae 
Ni and N2. Neighborhood 512 is constructed with a center 
minutia Nq* and two neighbor minutiae Nj* and N2'. As can 
be seen, neighborhood 510 and neighborhood 512 show 
some resemblance, i.e., neighbor minutiae Nj and Nj and 
Nj* and Nj', respectively, have similar positional relation- 
ships with respect to their center minutiae Nq and Nq', 
respectively. However, there are slight differences between 
the two neighborhoods. As described above, the definition of 
the fingerprint varies under certain conditions, therefore, 
tolerance must be accepted. Depending on the predeter- 
mined tolerance, neighborhood 510 may or may not match 
neigbboriiood 512. 

FIG. 7A shows data chunk 201 of fingerprint template T^ 
in detail. Data chunk 201 includes three parameters: location 
702, minutia angle 704, and neighborhood 706. Location 
702 includes x- and y-coordinates. Neighborhood 706, in 
one embodiment, includes 15 neighbor minutiae N^^ 
through Nji5. Each neighbor N^ through Nj^j further 
includes positional parameters such as distance d.^^ between 
the center minutia Nq and the neighbor minutia N^^ and two 
related angles (f)^, where i is 1 through 15, as shown in 
no. 7C. 

Similarly, FIG. 7B shows data chunk 211 of fingerprint 
template T2 in detail. Data chunk 211 includes three param- 
eters: location 752, minutia angle 754, and neighboriiood 
756. Location 752 includes x- and y-ooordinates Xy and y2,-. 
Neighborhood 756, in one embodiment, includes 15 neigh- 
bors N21 through N2i5. Each neighbor through N215 
further includes positional parameters such as distance &2i 
between the center minutia Nq and a neighbor N2,- and two 
related angles ^2if ^2/' where i is 1 through 15, as shown in 
FIG. 7D. Although FIGS. 7Aand 7B show the same number 
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of neighbors in data chunk 201 and data chunk 211, it is not 
necessary because a neighborhood match may be found if 
the number of neighbor minutia matches satisfies the pre- 
determined number of neighbor minutia matdies. 

After fingerprint templates and T2 are created and 
stored in a memory, fingerprint templates and T2 are 
compared for matching minutiae using a fingerprint template 
matching algorithm. In one embodiment, the fingerprint 
template matching algorithm is similar to the one dcscnbed 
in U.S. patent application Ser. No. 09/354,929 incorporated 
by reference above. 

FIG. 8 illustrates one embodiment of fingerprint template 
matching algorithm. The algorithm starts in step 800. In one 
embodiment, the data chunl^ arc sorted in step 802, but such 
sorting is optional. In one embodiment, the data chunks are 
sorted in accordance to their x-coordinates. In another 
embodiment, the data chunks are sorted in accordance to 
their y-coordinates. In one embodiment, the data chunks in 
fingerprint template are sorted. In another embodiment, 
the data chunks in fingerprint template T2 are sorted. In yet 
another embodiment, the data chunks in both fingerprint 
templates Tj and arc sorted. 

A data chunk from each fingerprint template Tj and T2 is 
loaded into a random access memory (RAM) (step 804). The 
data chunks are then compared in step 806. The data chunks 
arc compared by comparing, e.g., location (x^.y^-) , minutia 
angle dj and neighborhood NHy. The order of the comparison 
may be varied. For example, the x-coordinates are compared 
first. In another embodiment, the y-coordinates are com- 
pared first. 

In one embodiment, the location comparison is straight 
subtraction. If the difference for a parameter pair is equal to 30 
or less than a respective predetermined tolerance, the param- 
eters match. For minutia angle comparison, if the absolute 
value of the difference is less than or equal to a predeter- 
mined tolerance, the minutia angles match. If the absolute 
value of the difference is greater than the predetermined 
tolerance, whether the absolute value of the difference is 
greater than or equal to the difference between the maximum 
allowable quantized minutia angle and the predetermined 
tolerance is determined. If the absolute value of the differ- 
ence is greater than or equal to the difference between the 
maximum allowable quantized minutia angle and the pre- 
determined tolerance, the minutia angles match. 

The neighbor to neighbor comparison includes comparing 
distance d^ angle and angle of a neighbor to the 
respective parameters in another neighbor. In one 
embodiment, the neighbors in a neighborhood are sorted by, *5 
for example, distance d^. If the number of the neighbor 
matches is equal to or greater than a predetermined match 
rate, the neighborhoods match. If any of the parameters, i.e., 
distance d.-, angle or angle fail to match, the neighbors 
do not match. 

If all of the parameters, i.e. location, minutia angle and 
neighborhood, match, the data chunks match (step 808). A 
counter is incremented and the matching minutia pair is 
stored at a memory location where it can be accessed by a 
computer (step 810). The matching minutia pair is stored as 
part of a matching minutia set. If the number of data chunk 
matches in the counter satisfies a predetermined match rate 
(step 812), fingerprint templates T^ and T2 match (i.e., there 
is a sufiOcient overlap region between the two fingerprint 
templates) (step 814) and the process ends (step 816). 

On the other hand, if any of the minutia characterization 
parameters fail to match, the data chunks do not match and 
the next set of data chunks are compared. In one 
embodiment, if the data chunk in fingerprint template T^ and 
the data chunk in fingerprint template T2 do not match, 
whether the last-compared data chunk in fingerprint tem- 
plate T2 is the last data chunk in fingerprint template T2 is 
determined (step 818). If the last-compared data chunk is not 



40 
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the last data diunk in fingerprint template T2, the next data 
chunk in fingerprint template T2 is loaded into the RAM to 
be compared with the last-compared data chunk in finger- 
print template T^ (step 820). The process continues until all 
the data chunks in fingerprint template T2 have been com- 
pared. 

Next, whether the last-compared data chunk in fingerprint 
template T^ is the last data chiink in fingerprint template T^ 
is determined (step 822). If the last-compared data chunk is 
not the last data chunk in fingerprint template T^, the next 
data chimk in fingerprint template T^ and the first data chunk 
in fingerprint template T2 are then loaded into the RAM to 
be compared (step 824). The process continues until all the 
data chunks in fingerprint template T^ have been compared. 
If the last-compared data chunk is the last data chunk in 
fingerprint template T^, fingerprint templates T^ and T2 do 
not match (step 826) and the process terminates in step 816. 
In one embodiment, an indication, e.g., visual or audio, 
indicates that the two fingerprint images do not have a 
sufficient overlap region. 

If there is a match between fingerprint template T-t and 
fingerprint template T2, there is a sufBdcnt overlap region 
and the fingerprint templates are ready to be combined. FIG. 
9 shows a flowchart of how two fingerprint templates are 
combined. The process starts with step 900. Registration 
parameters are calculated for the matdiing minutiae pairs 
stored in the memory in step 902. For the P matching 
minutia pairs M^^^^,,,^ and M2cammp> the registration param- 
eters are calculated as follows: 



35 



1^1 



0 ~ 02eoam9>) ' 



In the embodiment described above, the registratioD is 
with reference to fingerprint template T^. In the alternative, 
the registration parameters can be calculated in reference to 
fingerprint template Tj. 

In a simplest case, fingerprint template Ti and fingerprint 
template T2 have only one matching pair (M^^^^,, 



i). Then, P is equal to 1. Minutia M^^ 



L in partial 



50 



55 



fingerprint image 22 has a location x^^^^^lO, yi,^i=10 
and 6ieommi°100** and the corresponding minutia M2commi 
in partial fingerprint image 24 has a location X2«^i-20, 
y2c«n«i-20 and e2^^j«115**. The registration parameters 
are calculated as follows: 



JtflMi,2> = ^00 - 20)/l = -lO 
1 

2 

>'^(Ui = ^(10-20)/! = -10 
1 

2 

O^U) = X (100^ - 115^) / 1 = - 150 



60 



65 



In one embodiment, the rotation registration 6^^^^^^ is 
calculated in complex domain as described above. 

Next, all the minutiae in fingerprint template T2 are 
translated in accordance with the registration parameters so 
that fingerprint template Tj and fingerprint template T^ are 
on the same coordinate system (step 904). Translation is 
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accomplished, in one embodiinent, by adding a correspond- the right side of the rectangle; and the lowest minutia 

ing registration value to the location/angle values of all Micomm* defines the bottom side of the rectangle. The 

minutiae in the fingerprint template that is not the reference remaining minutiae are grouped as uncommon minutia set 

fingerprint template. For example, if x^^j^^j 2)°-10^ Vofliw M 

(1.2)=- 10 and 0^^i^)°-15**, and M^commi has X2^c^j=20, 5 Similarly, for the second minutia set Mj, the overlap 

y2c«n»ii°20 and 62co»»mi°115**, then M^2c<mtmi bas ^2commi° region is drawn as the smallest possible rcctapgular box 

10» y'2commi°10» ^^comnti"^^^- translated minutia around the conomon minutia set Mj^^^, e.g., minutiae 

is now on the same coordinate system and aUgned M^^, M^^^^, Ma,,^, M^,,^ and Ma^j, using 

to minutia M^^^^^^^. It is noted that if the difference (sum in minutia ^2^^^^^ to define the left boundary, minutia 

equation)of the minutia angles exceeds 360** (or 2jc in 10 Mj^^^^i to define the top and the right boundaries and 

radians) or less than -360** (or -2jc in radians), it wraps minutia M2co^4 to define the bottom boundary of the 

around. overlap region. The remaining minutiae outside of overlap 

Once the fingerprint templates T^ and T^ are on the same region are grouped as uncommon minutia set M2toKcmm2- 

coordinate system, they can be combined easily. In one Notice that overlap region boimdaries for overlap region 

embodiment, the P matching minutiae in either fingerprint is arc rotated from the overlap region boundaries for overlap 

template T-i or fingerprint template are placed in the region R-|. Included in overlap region R2 is a minutia 

combined template T^^^^^^j (step 906). An overlap region M2unccmmi has no corresponding matching minutia in 

is then calculated in step 908. Step 908 will be described in overiap region R^. 

details below. The minutiae in fingerprint template T^ and Next, all minutiae in the second minutia set shown in FIG. 

fingerprint template T^ that are not matched are then placed 20 IIB are translated with reference to the first minutia set 

in the combined template T^^^j (step 910). shown in FIG. IIA, using the registration parameters cal- 

FIGS. lOA through lOD illustrate graphically how two culated in the maimer described above. After translation, all 

fingerprint templates each representing a sensed area of a minutiae in the second minutia set M2 are on the same 

fingerprint are merged together. FIG. lOA shows a first coordinate system as first minutia set M^. FIG. IIC shows 

minutia set representing the minutiae in fingerprint template 25 the translated minutia set M2'. It is noted that the overlap 

T^ containing minutiae from a portion of a finger. The first region can be of any other shape. First minutia set and 

minutia set includes an uncommon minutia set Mi„„,;^y,^ translated second minutia set M2' are then combined in a 

containing uncommon minutiae M^^^^^^^^^^^ and M^^^^;,,,,^ maimer described above. 

and a common minutia set M^^^,^ containing common In one embodiment, either common minutia set M^^ 

minutiae M^^^^^j, ^icomm2* Micom«3» Mac««m4 and 30 or common minutia set is placed in a coi 

M^commS' f^G. lOB shows a second minutia set representing minutia set M^^„„i,^^. Since common minutia set M^^, 

the minutiae in fingerprint template T2 containing minutiae and common minutia set M^comm contain matching 

from another portion of the same finger. The second minutia minutiae, only one needs to be placed in the combined 

set includes an uncommon minutia set M2tt„comm including minutia set M^^^^ 

uncommon minutiae M^^nc^^i* ^^^^uftconvnz^ M2««com«3 and 35 Next, the uncommon minutia set M.^^^^ is placed in 

^2uiicomin4 ^^d a commou minutia set M^eomm including the combined minutia set Mc,,,,,^^^. Similarly, the uncom- 

common minutiae Ma^^i, M2«>««2» ^T^^cn^f Ma^^ mon minutia sets M2u»commi and M^^,,,,^,,^ arc placed in 

and M2comm5' Common minutia set M.2ccmm and common the combined minutia set M^omto^- ^ one embodiment, 

minutia set M^^^^,^ contains matching minutiae of the uncommon minutia Msocmmi ^ discarded and not included 

images taken from different portions of a fingerprint. 40 in the combined minutia set M^,;,,,,^^^. Uncommon minutia 

FIG. IOC shows a translated second minutia set in refer- Mj^^mmi is discarded because it falls within the overlap 

ence to the first minutia set. The translated second minutia region yet has no corresponding matching minutia, hence, 

set includes a translated common minutia set M'2comm ^n- may be a false minutia. 

taining translated common minutiae M'2commi* ^^icommz* 'n one embodiment, if any minutia has a negative 
M'2co««4 and M 

^zeomrns and a translated uncom* 4S x-coordinate or a negative y^coordioate, the entire combined 

mon minutia set ^2Mt7tctmtm containing translated uncommon minutia set M^^^^^^j is shifted so that aU minutiae have a 

minutiae M'^unaammi* M'2«nct>mm2» ^'nunaomms and positivc x-coordiuate and a positivc yKX)ordinatc. This shift- 

M'2«„«^- ing is optional. 

FIG. lOD shows a combined minutia set ^combin^d con- The combined minutia set can be either stored in a 

structed from the first minutia set and the translated second 50 memory as a reference fingerprint template or used as a 

minutia set. In one embodiment, combined minutia set measured fingerprint template to be verified. 

^combined ^ conslructed from the uncommon minutia set The above-desoibed method combines two fingerprint 

^luncommf unoommon minutia set M'2ttncomm and common templates extracted firom two fingerprint images taken at 

minutia set Mj^^^,^ or M^comm- that only one common different positions into one single fingerprint template by 

minutia set M^^^,^ or M^^^^,^ needs to be used because they 55 matching and then combining the fingerprint templates of 

represent the same area of a fingerprint. the two fin^rprint images. This method creates a combined 

In another embodiment, shown in FIGS. IIA through fingerprint template as if extracted from one image, thus 

IID, the overlap region between the two fingerprint tem- eliminating additional steps to anooth out the artifact effect 

plates is calculated by defining the maximum and minimum exhibited by the prior art where two images are pasted 

X and y values for the common minutiae. For the first 60 together. In addition, this method can be accomplished with 

minutia set M^i, the overlap region R^, in one embodiment, a computer with low computational power, 

is drawn as the smallest possible rectangular box around the Additional fingerprint templates from other sensed areas 

common minutia set M^^^^, e.g., minutiae M^^^^^j, of a fingerprint can be combined in a similar fashion. For 

example, if a third template is created from the same finger 
and the third template has a sufiSdent overlap region with 

the rectangle; the highest minutia M^^^^^j defines the upper either the first or the second template, the third template can 

side of the rectangle; the rightmost minutia M^,^^! defines be combined with the first and the second templates. In one 
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embodiment, the first template and the second template are 
combined into a combined template with reference to, e.g., 
the first template. The combined template can then be 
combined with the third template translated with reference 
to the first template to derive a combined template which 5 
represents all three fingerprint templates. Of course, various 
combinations may be used. 

For example, matching scores can be assigned to each 
comparison based on the percentage of match. For example, 
the first fingerprint template and the second fingerprint 
template have a matching score of 10; the first fingerprint 
template and the third fingerprint template have a matching 
scores of 5; and the second fingerprint template and the third 
fingerprint template have a matching scores of 10; then the 
first and the third fingerprint templates will not be combined 
due to a poor match. Instead, the first and the second 
fingerprint templates are combined to derive a first com- 
bined template; the second and the third fingerprint tem- 
plates arc combined to derive a second combined template; 
the first and the second combined templates are then com- 
bined to derive the composite fingerprint template. In 20 
general, for each combination, all fingerprint templates must 
be aligned, i.e., using the same coordinates. 

Although the invention has been described with reference 
to particular embodiments, the description is only an 
example of the invention apphcation and should not be taken 25 
as a limitation. Various other adaptations and combinations 
of features of the embodiments disclosed arc within the 
scope of the invention as defined by the following claims. 

I claim: 

1. A method for combining two templates, comprising: 
providing a first template having a first mimitia set and a 

second template having a second minutia set; 
comparing said first template with said second template to 

obtain a matching minutia set; 
calculating registration parameters from said matching 

minutia set; 

translating all minutiae in said first minutia set u^ng said 
registration parameters so that said first minutia set and 
said second minutia set are on the same coordinates; 

combining said first minutia set with said second minutia 
set to derive a combined minutia set; 

creating a first overlap region in said first minutia set, said 
first overlap region comprising at least matching minu- 
tiae for said first template in said matching minutia set; 

creatiiig a second overlap region in said second minutia 
set, said second overlap region comprising at least 
matching minutiae for said second template in said 
matcMrig minutia set, 

wherein creating said first overlap region and said 
second overlap region includes: 

creating a smallest possible rectangle enclosing said ^ 
matching minutiae for said first template in said 
first minutia set; and 
creating a smallest possible rectangle enclosing said 
matching minutiae for said second template in said 
second minutiae set; and 55 
discarding minutiae in said first overlap region that are not 

part of said matching minutiae set; and 
discarding minutiae in said second overlap region that are 
not part of said matching minutiae set. 

2. The method of claim 1, wherein said providing a first 60 
template and a second template comprises creating a data 
chunk for each minutia making up said first template and 
each minutia making up said second template. 

3. The method of claim 1, wherein said providing a first 
template and a second template comprises characterizing 65 
each minutia in said first minutia set and said second minutia 
set. 
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4. The method of claim 3, wherein said characterizing 
comprises: 

calculating a location, said location comprising an 

x-coordinate and a y-coordinate; 
calculating a minutia angle; and 
creating a neighborhood. 

5. The method of claim 4, wherein said creating a neigh- 
borhood comprises: 

selecting a center minutia; and 

selecting a predetermined number of neighbor minutiae. 

6. The method of claim 5, further comprising: 
calculating a distance between said center minutia and 

one of said neighbor minutiae; 

calculating a first angle between a first line drawn 
between said center minutia and said one of said 
neighbor minutiae and an x-axis tangential to a ridge 
line of said center minutia; and 

calculating a second angle between a second line tangen- 
tial to a ridge line of said one of said neighbor minutiae 
and said x-axis. 

7. The method of claim 1, wherein said comparing com- 
prises: 

comparing a location of a minutia in said first minutia set 
with a location of a corresponding minutia in said 
second minutia set; 

comparing a minutia angle of said minutia in said first 
minutia set with a minutia angle of said corresponding 
minutia in said second minutia set; and 

comparing a neighborhood of said minutia of said first 
minutia set with a neighborhood of said corresponding 
minutia in said second minutia set. 

8. The method of claim 7, wherein said comparing a 
minuda angle of said minutia in said first minutia set with a 
minutia angle of said corresponding minutia in said second 
minutia set comprises comparing in complex domain. 

9. The method of claim 1, wherein said calculating 
comprises: 

calculating an x-coordinate oflEsct value; 
calculating a y-coordinate oSiset value; and 
calculating a minutia angle ofiiset value. 

10. The method of claim 9, wherein said calculating an 
x-coordinate ofiEset value comprises: 

calculating an x-coordinate difference between 
x-coordinates of a minutia pair in said matching minu- 
tia set; 

summing said x-coordinate difference of each said minu- 
tia pair to obtain a sum; and 

dividing said sum with the number of minutia pairs in said 
matching minutia set. 

11. The method of claim 9, wherein said calculating an 
y-coordinate offiset vahie comprises: 

calculating a y-coordinate difference between 
y-coordinates of a minutia pair in said matching minu- 
tia set; 

summing said y-coordinate difference of each said minu- 
tia pair to obtain a sum; and 

dividing said sum with the number of minutia pairs in said 
matching minutia set. 

12. The method of claim 9 wherein said calculating an 
minutia angle offiset value comprises: 

calculating minutia angle difference between minutia 
angles of a minutia pair in said matching minutia set; 

summing said minuda angle difference of each said 
minutia pair to obtain a sum; and 
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dividing said sum with the number of minutia pairs in said 
matching minutia set 

13. The method of claim 9, wherein said calculating a 
minutia angle ofiket vahie comprises calculating said minu- 
tia angle offset value in complex domain. 

14. The method of claim 9, wherein said translating 
comprises: 

adding said x-coordinate ofiEset vahie to an x-coordinate 
value of each minutia in said first minutia set; 

adding said y-coordinate ofket value to a y-coordinate 
value of each minutia in said first minutia set; 

adding said minutia angle of^t value to a minutia angle 
of each minutia in said first minutia set. 

15. The method of daim 1, wherein said combining 
comprises storing said matching minutiae in said first minu- 
tia set in a combined minutia set. 

16. The method of claim 1, wherein said combining 
comprises storing said matching minutiae in said second 
minutia set in a combined minutia set 

17. The method of claim 1, wherein said combining 
comprises storing minutiae in said first minutia set not a part 
of said matching minutia set in a combined minutia set. 

18. The method of claim 1, wherein said combining 
comprises storing minutiae in said second minutia set not a 
part of said matching minutia set in a combined minutia set. 

19. The method of claim 1, further comprising shifting 
each minutia in said combined minutia set by a same amount 
so that each parameter in said combined minutia set has a 
positive value. 

20. A computer readable medium having stored therein 
one or more sequences of instructions configured to cause a 
microprocessor to perform acts for combining two 
templates, the acts comprising: 
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providing a first template having a first minutia set and a 
second template having a second minutia set; 

comparing said first template with said second template to 
obtain a matching minutia set; 
^ calculating registration parameters from said matching 
minutia set; 

translating all minutiae in said first minutia set using said 
registration parameters so that said first minutia set and 
said second minutia set are on the same coordinates; 
combining said first minutia set with said second minutia 

set to derive a combined minutia set; 
creating a first overlap region in said first minutia set, said 
first overlap region comprising at least matching minu- 
15 tiae for said first template in said matching minutia set; 
creating a second overlap region in said second minutia 
set, said second overlap region comprising at least 
matching minutiae for said second template in said 
matching minutia set, 
20 wherein creating said first overlap region and said 
second overlap region includes: 
creating a smallest possible rectangle enclosing said 
matching minutiae for said first template in said 
first minutia set; and 
^ creating a smallest possible rectangle enclosing said 

matching minutiae for said second template in said 
second minutiae set; and 
discarding minutiae in said first overlap region that are not 

part of said matching minutiae set; and 
discarding minutiae in said second overlap region that are 
not part of said matching minutiae set. 

* ♦ ♦ ♦ ♦ 
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